Are cause of death data for Shanghai fit for purpose? A retrospective study of medical records.

OBJECTIVES: To assess the quality of cause of death reporting in Shanghai for both hospital and home deaths. DESIGN AND SETTING: Medical records review (MRR) to independently establish a reference data set against which to compare original and adjusted diagnoses from a sample of three tertiary hospitals, one secondary level hospital and nine community health centres in Shanghai. PARTICIPANTS: 1757 medical records (61% males, 39% females) of deaths that occurred in these sample sites in 2017 were reviewed using established diagnostic standards. INTERVENTIONS: None. PRIMARY OUTCOME: Original underlying cause of death (UCOD) from medical facilities. SECONDARY OUTCOME: Routine UCOD assigned from the Shanghai Civil Registration and Vital Statistics (CRVS) system and MRR UCODs from MRR. RESULTS: The original UCODs as assigned by doctors in the study facilities were of relatively low quality, reduced to 31% of deaths assigned to garbage codes, reduced to 2.3% following data quality and follow back procedures routinely applied by the Shanghai CRVS system. The original UCOD had lower chance-corrected concordance and cause-specific mortality fraction accuracy of 0.57 (0.44, 0.70) and 0.66, respectively, compared with 0.75 (0.66, 0.85) and 0.96, respectively, after routine data checking procedures had been applied. CONCLUSIONS: Training in correct death certification for clinical doctors, especially tertiary hospital doctors, is essential to improve UCOD quality in Shanghai. A routine quality control system should be established to actively track diagnostic performance and provide feedback to individual doctors or facilities as needed.

Improving the Policy Utility of Cause of Death Statistics in Sri Lanka: An Empirical Investigation of Causes of Out-of-Hospital Deaths Using Automated Verbal Autopsy Methods.

Background: Setting public health policies and effectively monitoring the impact of health interventions requires accurate, timely and complete cause of death (CoD) data for populations. In Sri Lanka, almost half of all deaths occur outside hospitals, with questionable diagnostic accuracy, thus limiting their information content for policy. Objectives: To ascertain whether SmartVA is applicable in improving the specificity of cause of death data for out-of-hospital deaths in Sri Lanka, and hence enhance the value of these routinely collected data for informing public policy debates. Methods: SmartVA was applied to 2610 VAs collected between January 2017 and March 2019 in 22 health-unit-areas clustered in six districts. Around 350 community-health-workers and 50 supervisory-staffs were trained. The resulting distribution of Cause-Specific-Mortality-Fractions (CSMFs) was compared to data from the Registrar-General's-Department (RGD) for out-of-hospital deaths for the same areas, and to the Global-Burden-of-Disease (GBD) estimates for Sri Lanka. Results: Using SmartVA, for only 15% of deaths could a specific-cause not be assigned, compared with around 40% of out-of-hospital deaths currently assigned garbage codes with "very high" or "high" severity. Stroke (M: 31.6%, F: 35.4%), Ischaemic Heart Disease (M: 13.5%, F: 13.0%) and Chronic Respiratory Diseases (M: 15.4%, F: 10.8%) were identified as the three leading causes of home deaths, consistent with the ranking of GBD-Study for Sri Lanka for all deaths, but with a notably higher CSMF for stroke. Conclusions: SmartVA showed greater diagnostic specificity, applicability, acceptability in the Sri Lankan context. Policy formulation in Sri Lanka would benefit substantially with national-wide implementation of VAs.

Improving medical certification of cause of death: effective strategies and approaches based on experiences from the Data for Health Initiative.

BACKGROUND: Accurate and timely cause of death (COD) data are essential for informed public health policymaking. Medical certification of COD generally provides the majority of COD data in a population and is an essential component of civil registration and vital statistics (CRVS) systems. Accurate completion of the medical certificate of cause of death (MCCOD) should be a relatively straightforward procedure for physicians, but mistakes are common. Here, we present three training strategies implemented in five countries supported by the Bloomberg Philanthropies Data for Health (D4H) Initiative at the University of Melbourne (UoM) and evaluate the impact on the quality of certification. METHODS: The three training strategies evaluated were (1) training of trainers (TOT) in the Philippines, Myanmar, and Sri Lanka; (2) direct training of physicians by the UoM D4H in Papua New Guinea (PNG); and (3) the implementation of an online and basic training strategy in Peru. The evaluation involved an assessment of MCCODs before and after training using an assessment tool developed by the University of Melbourne. RESULTS: The TOT strategy led to reductions in incorrectly completed certificates of between 28% in Sri Lanka and 40% in the Philippines. Following direct training of physicians in PNG, the reduction in incorrectly completed certificates was 30%. In Peru, the reduction in incorrect certificates was 30% after implementation and training on an online system only and 43% after training on both the online system and basic medical certification principles. CONCLUSIONS: The results of this study indicate that a variety of training strategies can produce benefits in the quality of certification, but further improvements are possible. The experiences of D4H suggest several aspects of the strategies that should be further developed to improve outcomes, particularly key stakeholder engagement from early in the intervention and local committees to oversee activities and support an improved culture in hospitals to support better diagnostic skills and practices.

Implementing the PHMRC shortened questionnaire: Survey duration of open and closed questions in three sites.

BACKGROUND: More countries are using verbal autopsy as a part of routine mortality surveillance. The length of time required to complete a verbal autopsy interview is a key logistical consideration for planning large-scale surveillance. METHODS: We use the PHMRC shortened questionnaire to conduct verbal autopsy interviews at three sites and collect data on the length of time required to complete the interview. This instrument uses a novel checklist of keywords to capture relevant information from the open response. The open response section is timed separately from the section consisting of closed questions. RESULTS: We found the median time to complete the entire interview was approximately 25 minutes and did not vary substantially by age-specific module. The median time for the open response section was approximately 4 minutes and 60% of interviewees mentioned at least one keyword within the open response section. CONCLUSIONS: The length of time required to complete the interview was short enough for large-scale routine use. The open-response section did not add a substantial amount of time and provided useful information which can be used to increase the accuracy of the predictions of the cause of death. The novel checklist approach further reduces the burden of transcribing and translating a large amount of free text. This makes the PHMRC instrument ideal for national mortality surveillance.

A shortened verbal autopsy instrument for use in routine mortality surveillance systems.

BACKGROUND: Verbal autopsy (VA) is recognized as the only feasible alternative to comprehensive medical certification of deaths in settings with no or unreliable vital registration systems. However, a barrier to its use by national registration systems has been the amount of time and cost needed for data collection. Therefore, a short VA instrument (VAI) is needed. In this paper we describe a shortened version of the VAI developed for the Population Health Metrics Research Consortium (PHMRC) Gold Standard Verbal Autopsy Validation Study using a systematic approach. METHODS: We used data from the PHMRC validation study. Using the Tariff 2.0 method, we first established a rank order of individual questions in the PHMRC VAI according to their importance in predicting causes of death. Second, we reduced the size of the instrument by dropping questions in reverse order of their importance. We assessed the predictive performance of the instrument as questions were removed at the individual level by calculating chance-corrected concordance and at the population level with cause-specific mortality fraction (CSMF) accuracy. Finally, the optimum size of the shortened instrument was determined using a first derivative analysis of the decline in performance as the size of the VA instrument decreased for adults, children, and neonates. RESULTS: The full PHMRC VAI had 183, 127, and 149 questions for adult, child, and neonatal deaths, respectively. The shortened instrument developed had 109, 69, and 67 questions, respectively, representing a decrease in the total number of questions of 40-55%. The shortened instrument, with text, showed non-significant declines in CSMF accuracy from the full instrument with text of 0.4%, 0.0%, and 0.6% for the adult, child, and neonatal modules, respectively. CONCLUSIONS: We developed a shortened VAI using a systematic approach, and assessed its performance when administered using hand-held electronic tablets and analyzed using Tariff 2.0. The length of a VA questionnaire was shortened by almost 50% without a significant drop in performance. The shortened VAI developed reduces the burden of time and resources required for data collection and analysis of cause of death data in civil registration systems.

Assessing the reliability of causes of death reported by the Vital Registration System in Sri Lanka: medical records review in Colombo.

Information on causes of death is critical for informed decision making in the health sector. This paper reports findings from a study that measured the accuracy of registered causes of death and quality of medical records for a sample of deaths occurring in hospitals in Colombo, Sri Lanka. Five physicians, trained in medical certification of cause of death, reconstructed death certificates for hospital deaths from medical records and assessed the quality of medical records for this purpose. The majority of medical records were found to be of average quality. Concordance between the underlying cause of death in the vital registration data and that from the 'gold standard' (medical records review) diagnosis was 41.4% (n=249). The sensitivity of all leading causes of death and positive predictive value were below 67%. Major misclassification errors were found in identifying deaths due to vascular diseases and diabetes mellitus. Certified causes of death in Sri Lanka are frequently incorrect, thus limiting their value for health policy and for monitoring progress towards development goals. Sri Lanka, and other countries at a similar level of statistical development, should consider periodically conducting research to evaluate the quality of cause of death reporting at both local and national levels.